FILTER MODE ACTIVE

#long-context LLMs

Records found: 2

#long-context LLMs07/09/2025

Meta's REFRAG Unlocks 16× Longer Contexts and Up to 31× Faster RAG Decoding

'Meta Superintelligence Labs released REFRAG, a decoding framework that compresses retrieved passages to enable 16× longer contexts and up to 30.85× faster time-to-first-token while preserving accuracy.'

READ →

#long-context LLMs30/04/2025

Rethinking Sparse Attention: Breakthroughs for Efficient Long-Context Large Language Models

Researchers from Edinburgh, Cohere, and Meta demonstrate that large sparse models can outperform smaller dense models for long-context LLMs by leveraging sparse attention, offering new scaling laws and standardized methods.

READ →